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1 Introduction 


The H cc control problem has been studied extensively. First in continuous-time (see e.g. [3, 
4, 10, 13]) and later in discrete time (see e.g. [1, 8, 6, 14]). For a more extensive reference list 
we refer to two recent books [2, 15]. 

The objective of this paper is to present a solution of the general discrete-time Hoo control 
problem. One way to approach this problem is to transform the discrete-time Hoo optimal 
control problem into an equivalent continuous-time Hoc control problem via bilinear trans- 
formation. Then the continuous-time controllers that are solutions to the auxiliary problem 
can be obtained and transformed back to their discrete-time equivalent using inverse bilinear 
transformation. However, in our opinion it is more natural to solve this problem directly 
in discrete-time setting and in terms of the original system’s performance. This approsich 
leaves the possibility of directly observing the effect of certain physical parameters which 
might otherwise be blurred by the transformation to continuous-time. In view of this, and 
in accordance with earlier literature [1, 6, 8. 12], we take this direct approach in solving the 
discrete-time Hoo optimal control problem. 

Compared to the existing literature, we solve this problem under weaker assumptions. All the 
existing literature on the discrete-time //<*, control problem maix the following assumptions 
on the system: 

• The subsystem from the control input to the control output should be left invertible 
and shoud not have invariant zeros on the unit circle. 

• The subsystem from the disturbance to the measurement output should be right invert- 
ible and should not have invariant zeros on the unit circle. 

These conditions are the discrete time analogon of what is called regular problems in contin- 
uous time control problems. In this paper, we remove the above mentioned left and right 
invertibility condition . 

Moreover, we give a representation of one controller in a suitable form such that it becomes 
very transparent that this controller is a state and disturbance estimator in conjunction with 
a full-information feedback (i.e. a feedback of both state and disturbance). Such an interpre- 
tation was not available before and due to the involved formulas it was not very clear what 
kind of structure discrete time Hoo controllers should have. 

Finally, a novel aspect of this paper is that we show that if certain states or disturbances are 
observed directly, then this yields tlve possibility of deriving a controller of lower McMillan 
degree. Tills result again corresponds to these obtained in continuous-time case (see [16]). 

The notation in this paper will be fairly standard. By Af and 71 we denote the natural 
numbers and the real numbers, respectively. Moreover by a we denote the shift: 

(ax)(k) := x{k +1) Vfc € A t 

rank*; denotes the rank as a matrix with entries in the field AC. By 7l(z) we denote the field of 
real rational functions. Moreover, by A'* we denote the Moore-Penrose inverse of the matrix 
X. Finally, by p(X) we denote the spectral radius of the matrix A'. 



2 Problem formulation and main results 

We considei the following time-invariant system: 

( ax = Ax + Bu • f £w, 

y =Oii + Dnuu (2.1) 

Z - CiX + £> 21 « + 

where for all lb € A/", x(k) € 72" is the state, u(k) € 72 m is the control input, y(k) € TV is 
the measurement, w(k) € ft 9 is the unknown disturbance and z(k) € ft? is the output to be 
controlled. A,B,E,C\,C 2 , £> 12 . Ai and Z? 22 are matrices of appropriate dimension. 

If we apply a dynamic feedback law u = Fy to E then the closed loop system with zero initial 
conditions defines a convolution operator E c()F from tv to y. We seek a feedback law u = Fy 
which is internally stabilizing and which minimizes the /^-induced operator norm of E^ 
over all internally stabilizing feedback laws. We will investigate dynamic feedback laws of the 
form: 


{ op - lip + £y, 
u =Jl/p+A r y. 


( 2 . 2 ) 


We will say that the dynamic compensator Ef. given by (2.2), is internally stabilizing when 
applied to the system E, described by (2.1), if the following matrix is asymptotically stable: 


/ A + BNCt BM \ 

V LC X K )' 


(2.3) 


i.e. all its eigenvalues lie in the open unit disc. Denote by Gf the closed loop transfer matrix. 
The /^-induced operator norm of the convolution operator E c( ,f is equal to the Hoc norm of 
the transfer matrix Gf and is given by: 


IIGHUo := sup ||G F (c ,tf ) 

6€(0,2ir] 


M 

w l II' *1 


w € C‘ 2 , w ± 0 


where the £ 2 -norm is given by: 

\l/2 


IIpIIj 


:= ( £ P T ( k )P( k )] 

\ k=0 / 


and where ||.|| denotes the largest singular value. We shall refer to the norm ||Gf||oo as the 
Boo norm of the closed loop system. 

In this paper we will derive necessary and sufficient conditions for the existence of a dynamic 
compensator Ef which is internally stabilizing and which is such that the closed loop transfer 
matrix Gf satisfies ||Gf||<» < 1- By scaling the plant we can thus, in principle, find the 
infimum of the Hoc norm of the closed loop system over all stabilizing controllers. This will 
involve a search procedure. Furthermore, if a stabilizing Ef exists which makes the Hoc, norm 
of the closed loop system less than 1, then we derive an explicit formula for one particular F 
satisfying these requirements. We also give an alternative non-minimal representation for this 
controller whose structure makes clear that this controller is the interconnection of a current 



state and current disturbance estimator and a static full-information feedback. In section 5 
we show that in some cases we can reduce the dynamical order of the estimator and we will 
derive an explicit method to derive controllers of lower dynamical order. 

In the formulation of our main result we will need the concept of invariant zero. Recall that 
20 is called an invariant zero of the system (/l, B,C\ D) if 


, ( zol- A -B\ . ( si- A -B \ 

ra “ k * { C D j < rink ’ ! «’ { C D ) 

We can now formulate one of our main results. This is an extension of [1, 8, 14]. 


Theorem 2.1 : Consider the system (2.1). Assume that the systems (A, B,C 2 , D 2 \) and 
(A,E,C\,D 12 ) have no invariant zeros on the unit circle, The following statements are 
equivalent: 

(r) There exists a dynamic compensator hp of the form (2.2) such that the resulting closed 
loop system is internally stable and the closed loop transfer matrix Gp satisfies ||<jf||oc < 
1 . 

(«) There exist symmetric matrices P > 0 and Q > 0 such that 

( a ) We ha ve 

R> 0 , (2.4) 

where 

V := B T PB + D^D 2l , 

R := I-Dl 2 D 2i -E T PE+{E T PB + D? 2 Dn)V' (B r PE + Dl x D 22 ) . 


(b) P satisfies the discrete algebraic Riccati equation: 

T 

/flipjj. nir.1 

P 




where 

G(P) ■= 


Dl 

Dl 


d;,0„ \ + (b-’\ , X 
;,d s1 d;,d„ - 1 ) ye 1 ) \ a L > 


(c) For all z € C with |r| > 1, tre have 

zl — A -B -E 

rank, | B r PA + Dl x C 2 B T PB + Dl x D 2l B r PE+D^D 22 

E 7 PA + D 22 C'j E 7 PB 4- D 22 D 2X E T PE + D^D 22 - 1 


(2.5) 


( 2 . 6 ) 


- n + q + rank n(0 C}(2/ - A)~ X B + D 2i 



(2.7) 


(d) We have 
S> 0, 
where 


W := DnDjt + CtQC?, 

S := / - D 22 D 7 22 - CiQCj + (C 2 QCj + D 3] Dj 2 ) W* (QQCf + D n D r 22 ) . 


(c) Q satisfies the following discrete algebraic Riccati equation; 

T 


Q = AQA T + EE T 
where 


(CiQA 7 + D i7 E T \ t (CiQA T + D l2 ^\ 
“ \CiQA 7 + DkE 7 ) {V) \c 2 g,4 T + D ri E T ) 


H(Q) = (DnDl 2 D i3 Dl 2 ) + (Ci\ Q (Ci\\ 
\D 32 DJ 3 DnDlj-l) \Cn) w \C 3 ) 


( 2 . 8 ) 


(2.9) 


(/) For all z € C with |z| > 1, we have 


rank. 


zl - A AQCJ -f EDJ., AQCJ + ED 22 

-Ct CiQCj + DnDjn C,gCj + D, 2 Dj 2 

-C 2 C 2 QCJ + D 32 DJ, CiQCi + D 22 Dl 2 - I 


= n + q + tmk n{l) Ci(zI - A)~ l E + Dn 


(9) p{PQ) < i- 


Remarks : 

(»') Necessary and sufficient conditions for the existence of an internally stablizing feedback 
compensator which makes the II x , norm of the closed loop system less than some, a 
priori given, upper bound 7 > 0 can be easily derived from theorem 2.1 by scaling. 

(ii) In this paper, we only investigate controllers of the form (2.2). This is not an essential 
restriction, since it can be shown that we can not make the Hoo norm less by allowing 
more general, possibly even non-linear, causal feedbacks. 

For the special cases of full-information and 6tate feedback we can dispense with the second 
Riccati equation. Moreover, in these cases there always exist suitable static controllers. More 
specifically: 


• Full information case : C\ = 

In this case we have y\ — x and y 3 = w, i.e. we know both the state and the disturbance 
of the system at time k. It is easy to check that Q = 0 satisfies conditions (d)-(f). 




Moreover this guarantees that the coupling condition (g) is automatically satisfied. 
Therefore there exists a stabilizing controller which yields a closed loop system with the 
Hoc norm strictly less than 1 if and only if there exists a positive semi-definite matrix P 
satisfying conditions (a)-(c). Moreover in t hat case we can find static output feedbacks 
w = F\x + F 2 u> with the desired properties. One particular choice for F = (F\,F 2 ) is 
given by: 

F\ := -VUO'PA + Ul x C 2 ) + (l - V'Y)F 0 
F 2 := -V'^PE + Dlahi) 

where Fq is an arbitrary matrix such that A + BF\ is stable. 

• State feedback cast : C\ - /, D i2 = 0. 

In that case, it is easy to see that a necessary condition for the existence of n positive 
sem-definite matrix Q satisfying conditions (d)-(f) is that j|£> 2 2 || < I. In that case, it is 
easy to check that 

Q= E(l- D 2i D7 i2 )-'E' T 

satisfies conditions (d)-(f). Condition (g) liven reduces to 

I - D 22 D? 22 - E r PE > 0 (2.12) 

Moreover, condition (2.12) implies that condition (a) is automatically satisfied. There- 
fore there exists a stabilizing controller which yields a closed loop system with the 
//ociiorm strictly less than 1 if and only if there exists a positive semi-definite matrix 
P satisfying conditions (b),(c) and additionally condition (2.12). 

In that case we can find a static output feedback u — Fx with the desired properties. 
One particular choice for F is given by: 

F := - V't ( B t PA + Dj,C a 4- [B r PE A D? n D 22 )R~ X [(E T PA t + Z)J 2 C r ]) + (/ - VW)F U 

where F 0 is an arbitrary matrix such that .4 + BF is stable (which can be shown to 
always exist) and 

A z := A - BV 1 [B T PA 4- Dj,C’ 2 j, 

C z := C 2 - D 2X V'[B T PA + Dl x C 2 ) 

3 The proof of theorem 2.1 

The proof of theorem 2.1 is divided into three parts. Each part establishes the proof for a 
certain part of the theorem. Every part is framed up as a subsection with a heading that 
represents a significant feature of its proof technicjue or its overall achievement. The rational 
for dividing the proof into three parts is mainly due to the length and the complexity of the 


(2.13) 

(2.14) 


( 2 . 10 ) 

(2.11) 



3.1 The existence of a solution to the Algebraic Riccati equation 

In this subsection we assume that part (i) of the theorem 2,1 is satisfied we will show that the 
existence of P satisfying conditions (a)-(c) in (ii) of the theorem 2.1 is necessary. We begin 
with the following definition. 


Definition 3.1 ; Let a system E = (A, B,C,D) be given. The controllability subspace 72*(E) 
is the largest subspace X of 71" for which a mapping F exists such that 

( A + BF)X C X 
(C + DF)X = {0} 

and such that (A,B\) is controllable where B\ is defined by: 

Im B\ = X fl B Ac r D □ 


We next perform a basis transformation on the state and input spaces of E. We decompose 
the state space .V = 7v'( E c , ) X? where E c , = (.4. B. C\. D 2 ) and choose a basis adapted to 
this decomposition. We also decompose the controller input space 14 - Her V 9)142 where 
V is as defined in theorem 2.1. In the new bases, the matrices in the realization of E have a 
special form: 


4 _ (An + #S2# 
" V B r F 

C\= ( Cn 

C 2 = ( D r F 



B = | 

(Bn 

#iA 

1 


#J 

it 

(« 

D r ) , 


The above matrices have the following properties: 

• #n ) is controllable. 

• (A r , B r ,C r , D r ) is left invertible. 



(3.1) 


• (A r ,B r ) is slabilizable. 


If part (i) of theorem 2.1 holds, i.e., if the measurement feedback problem is solvable, then 
we also know that the full-information H ^ control problem is solvable. Let Fo be such that 
An - #n Fq is stable. Then it is easy to see that, after the preliminary feedback u = 
-( F F 0 )x 4- v the subspace 72*(E ei ) does not affect the output to be controlled and the 
dynamics restricted to 72*(E C ,) is stable. Hence the achievable norm using full-information 
feedback is completely determined by the following subsystem: 

(<7*2 = A r * 2 + B t v 2 + E 2 w, 

\ x = C r x 2 + D r v 2 + Z? 22 U>, 

However, for this subsystem the operator mapping the input v 2 to the output z is left invert- 
ible. Therefore we can apply the results from [2, 15] to obtain the following result: 


Lemma 3.2 : Consider (he systems £ and E r defined by (2.1) and (8.2) respectively. Assume 
that the system (j4, B,Cj, D^i) has no invariant zeros on the unit circle. Then also the system 
(A r , B r .C T ,D r ) has no invariant zeros on the unit circle. Moreover , the following statements 
are equivalent: 

(i) There exists a full information feedback u = F\X + Fi tv for the system E such that the 
resulting closed loop system is internally stable and the closed loop transfer matrix Gf 
satisfies ||C»jr||oc, < 1. 

(ii ) There exists a full information feedback u = F\ >T x + Fijtv for the system E r such that 
the resulting closed loop system is internally stable and the closed loop transfer matrix 
Gf.t satisfies ||Gf>||oc < 1. 

(»ii) There exists a symmetric matrix P T > 0 such that 
(a) We have 

V r >0. Rr > 0 
where 

V r := Bj P, B, + D)Dr. 

;= / - Dl,D T > - EjP r E r + (EjP r B r + Dj,D r ) V ," 1 (BjP r E r + Dj D K ) . 


(b) P T satisfies the discrete algebraic Riccati equation: 

t r 1 p_ 4_ 4. n i r \ 1 

Pr 


° -AiPA aC t C _(B7P..i, + D?c,\ i (b:p.a. + d;c.\ 

■\A' PrA ' +C ' C ' {eTP.A. A DLC.) GAF ' } X eJP.A, + D^C.) ’ 


where 


(c) The matrix A cl P is asymptotically stable where 

A.., A- (B . -E. ) CAP.r' ( **£ * ) 


o 


Proof : The implication (ii) O (iii) can be found in [15]. The implication (ii) => (i) can be 
easily checked using the arguments given before this lemma. 

The implication (i) — » (ii) can be derived in the following manner. First note that we can 
apply, without loss of generality the transformation u = FqX\ + v where Fq is such that 
/In + B\ Fq is stable. Suppose a stabilizing feedback, v = F\\X\ + FnXi + F 2 W exists for the 
system E (after our preliminary transformation) which yields a closed loop transfer matrix 


GV satisfying ||Gf||<x. < 1. Then it is easy to check that the following dynamic compensator 
stabilizes S r and yields the same closed loop transfer matrix Gf. 

f ax\ = Mu + Di2Fo)xi + Ault + F\U\ 

\ « = ^11*1 + F1212 + FiU'i 

However, E r has a subsystem from t >2 to z which is ieft-invertible and hence, from [14], we 
know that the existence of a suitable dynamic full-information feedback also guarantees the 
existem e of a static full-information feedback. ■ 

This lemma yields a solution P T of a discrete time Rjccati equation for the reduced order 
system. We can extend ibis matrix to the original state space by setting it zero on 72*(E^), 
i.e. if we define P by 



then P T satisfies the conditions of lemma 3.2 if and only if P satisfies the conditions of (a)-(c) 
of theorem 2.1. The above can be combined to yield: 


Lemma 3.3 : Assume ( A. B. C' 2 , ) has no invariant zeros on the unit circle. If part (i) 

of theorem 2.1 is satisfied then there exists a symmetric matrix P > 0 satisfying (a)-(c) of 
part (ii) of theorem 2.1. □ 


We also need to know whether any solution P satisfying conditions (a)-(c) of theorem 2.1 
can be connected to a matrix P r satisfying the conditions of lemma 3.2. This is done in the 
following lemma: 


Lemma 3.4 : Let P > 0 be a matrix satisfying the conditions (a) -(c) of theorem 2.1. Then 
her P D fc'(E cl -). 

Hence, in our new bases, P will be of the form (3.3) for some matrix P T . Moreover P T satisfies 
the conditions in part (iii) of lemma 3.2. □ 


Proof : First note that condition (b) implies that 
P > A r x PA x + CIC X 

where A x and C x are defined by (2.13) and (2.14) respectively. It is easily seen that this 
implies that Ker P i6 controlled invariant. 

Secondly conditions (a) and (c) imply that 

rank (21 T P B -I- f? 2 i^ 2 i) = rankjjjjjC^r/ — >1) + Z? 2 i 


These two properties, when combined with the decomposition of the 6tate space as introduced 
in the beginning of this section, yield the desired result. ■ 


Using P r , or equivalently P, we can also derive explicit formulas for static full-information 
compensators which achieve the desired objectives in parts (i) or (ii) This is outlined in the 
following lemma which is an extension of results in [2, 15]. 


Lemma 3.5 : Let the systems E and E r be defined by (2.1) and (S.2) respectively. Assume 
that a matrix P T > 0 exists satisfying the conditions in part (iii) of lemma 3.2. Moreover, 
define P by (S.S). 

• A controller satisfying the conditions of part (ii) of lemma 3.2 is described by: 

F hr := V- l (B?P r A r + D?C r ) 

F 2 , r := -V-'(B?P r E r + D T r D 2 2) 

• A controller satisfying the conditions of part (i) of lemma 3.2 is described by 

Ft = (-F Fis-Fo) 

F 2 = ( 0 P 2ir ) 

where F and Fq are. the parameters of the preliminary feedback described before lemma 
3.2. 

Alternatively, we can also descriltc a suitable controller for E in terms of the original 
system parameters of E: 

P, := -V'(B r PA + D T 2X C 2 ) + (1 ~V'V)F 
F 2 := -VUB t PE + D^D 22 ) 

where F is an arbitrary matrix such that A + BF\ is stable. 

Proof : The first part of this lemma is a direct result of [14]. The second part of this lemma 
gives two controllers of which it can be easily shown that when applied to the reduced order 
system they yield the same closed loop transfer matrix as the controller given in the first 
part of this lemma when applied to the original system. Hence the closed loop system has 
Poo norm strictly less than 1. Remains to check existence of a suitable P to yield internal 
stability of the closed loop system. This is shown by using the decomposition introduced 
in the beginning of this section together with stability of A r + B r F r and stabilizability of 
(i4n + B t2 F,Bu). m 

In the next subsection we show that the part (i) of theorem 2.1 also implies the remaining 
statements of the part (ii) of theorem 2.1. 


3.2 A first system transformation 

In this subsection we assume that part (i) of theorem 2.1 is satisfied and we show that part 
(ii) of the theorem 2.1 holds. A central component of the proof in this subsection is to 
transform the original system (2.1) into a new system. This transformation is designed such 
that the problem of finding an internally stabilizing feedback which makes the Hoc norm of 
the closed loop system less than 1 for the original system would be equivalent to the problem 
of finding an internally stabilizing feedback which makes the //«> norm of the closed loop 
system less than 1 for the new transformed system. Moreover, this new system has some 
very desirable properties which makes it much easier to work with. In particular, for this new 
system the disturbance decoupling problem with measurement feedback is solvable. We will 
perform the transformation in two steps. First we will perform a transformation related to 
the full-information H <» problem and next a transformation related to the filtering problem. 
We assume that we have a positive semi-definite matrix P satisfying conditions (a)-(c) of 
theorem 2.1. We define the following system: 

{ ox p = Apip + Bup + EpU'p , 

yp — (sipXp 4- D t ] { pWp, (3-4) 

Zp — C iP x P + D t \pXip + DnpWp, 

where, 

Ap := A + ER~\E r PA x + D r 22 C x ), 

E P := ER- 1 * 2 , 

C hP := C, -f D l2 R- l (E r PA r + D T 22 C X ). 

C t , P := {V'/ 2 )'(B' e PA + Dl 1 C 2 + {B T PE + Dl 1 D 22 ]R- l [(E T PA T + Dl 2 C T )), 

D 12 ,p := Z^/T 1 ' 2 , 

D»,p := V' 1 / 2 , 

D 31iP := (V l ' 2 )HB T PE + Dl l D 22 )R- l ' i , 

where the matrix P satisfies parts (a)-(c) of theorem 2.1 and the matrices A x and C x are 
defined by (2.13) and (2.14), respectively. 

In order to continue, we need the system to be in the special basis as defined in the previous 
section. Using lemma 3.4, we know that P is of the form (3.3) for some matrix P T . We can 
then define the following system: 

OX II — ApXp -f- B V Up ■+■ EpW, 

• * y v = i%u 4* w, (3.5) 

Zp = CiX’X u 4 " Diifi’Uu 4 " 

V T := BjP r B r A D T r D r 
A v := A r - BrV~' (BjP r A r 4- DICt) 

Bp := B r ( 0 ir 1/2 ) 

Ep := E 2 - BA'- 1 {BJP t E 2 4- D T r D 22 ) 


where 



C 3 'U Cr - D r v~' (BjPrAr + £> f T C r ) 

C x ,v := -R- l/2 (EtP r A v + Dl 2 C iiV ) 

D», v := R 1/2 

D». v := D r V-'/ 2 (o Vr~ l/2 ) 

D„, v := /? 22 - W 1 (BjP r E 2 + DJD22) 

where A is as defined in theorem 2.1. We will show that has a very nice property. In 
order to do this, we firs*, recall the definition of the so-called inner systems. Moreover, some 
of the important properties of inner systems are also recalled in the following two lemmas. 


Definition 3.6 : A system is called inner if the system is internally stable, square (i.e. the 
number of inputs is equal to the number of outputs) and the transfer matrix of the system, 
denoted by G, satisfies: 

G(z)G r (z- 1 ) = I (3.6) 


Lemma 3.7 : Let the following square system be given: 


( ox = Ax + Bu , 
z = Cx + Du. 


(3.7) 


Assume that A is asymptotically stable. The system is inner if there exists a matrix X 
satisfying: 


(а) X = A T XA + C r C 

(б) D T C + B r XA = 0 

(c) D r D + B T XB = l □ 


Proof : See [6, 15] 


Lemma 3.6 : Suppose we have the following interconnection of two systems Ei and E 2 , both 
described by some state space representation: 



(3.8) 



Assume Ei is inner. Denote its transfer matrix from (w,u) to ( 2 , y) by L. Moreover, assume 
that if we decompose L compatible with the sizes of w, u, 2 and y: 

‘CMS;: ;:)(:)-(;)• 

we have L^\ € Hoc and L 22 is strictly proper. Then the following two statements are equiva- 
lent: 

(<) The closed loop system (2.8) is internally stable and its closed loop transfer matrix has 
Ho* norm less than 1 . 

(it) The system E 2 is internally stable and its transfer matrix has Hoo norm less than 1. □ 


Proof : See [9, 13]. ■ 

Now, we are ready to conic back to the system E u and establish some of its properties in the 
following lemma. 


Lemma 3.0 : The system E w as defineu by (3.5) is inner. Denote the transfer matrix ofT, v 
by V . We decompose U compatible with the sizes of w, u v , z v and y v : 



U12 \ ( w \ _ / Sv 
U22 ) \ Uv ) \ Uv 


Then U 2 1 is invertible and its inverse is in Hoc • Moreover U 22 is strictly proper. □ 


Proof : It can be easily checked that P r satisfies the conditions (i)-(iii) of lemma 3.7. 
Condition (i) of lemma 3.7 turns out to be equal to the reduced order discrete algebraic 
Riccati equation as given in lemma 3.2. Conditions (ii) and (iii) follow by simply writing out 
the equations in terms of the system parameters of system (2.1). 

The stable matrix A clP , as defined in lemma 3.2, can be written in the following form: 

^ci,#> — A v — E v D^ v C it v (3.10) 

Next, we show that A v is asymptotically stable. We know P r > 0 and 


Pr = AlP T A v + ( Clu Cf v 



(3.11) 


It can be easily checked that * ^ 0, A v x = A.r, C i V x = 0 and C 2 ,vX = 0 implies that 
A ctP x = Xx. Since A cl P is stable we have Re A < 0. Hence the realization (3.5) is detectable. 
By standard Lyapunov theory the existence of a positive semi definite solution of (3.11) 
together with detectability guarantee asymptotic stability of A v . 



Wc can immediately write down a realization for Uj i* : 


{ oxv — A e i'PXit + EuD l3 \>u\ 

Vv = ~ Dti,vCi,v x v + 


Since j4 e i,p is stable we know that Ufj 1 is an H<x, function. Finally, the claim that U 22 is 
strictly proper i6 trivial to check. ■ 


We will now formulate our key lemma: 


Lemma 3.10 : Let P satisfy theorem 2.1 part (ii) (a)-(c). Moreover, let E/r be an arbitrary 
linear time-invariant finite-dimensional compensator in the form (2.2). Consider the following 
two systems, where the system on the left is the interconnection of (2.1) and (2,2) and the 
system on the right is the interconnection of (3.4) and (2.2): 



(3.12) 


Then the following statements are equivalent : 

(i) The system on the left is internally stable and its transfer matrix from w to z has 
Hoc norm less than 1. 

(ii) The system on the right is internally stable and its transfer matrix from w P to z P has 

Hoc norm less than 1. □ 


Proof : We investigate the following systems: 



(3.13) 






The system or. the left is the same as the system on the left in (3.12) and the system on the 
right is described by the system (3.5) interconnected with the system on the right in (3.12). 
A realization for the system on the right is given by: 


1 

^ Xv — *2,#>\ / A C i,p 0 

0 ) 



' 0 ' 

a \ 

Xp = * A + BNCi 

BM 


+ 

E+BNDn 

1 

< P / \ * LG\ 

A* ) 

l ? J 


\ L>D\2 ; 


w 


*v 


= ( * C 2 + 7? 21 AC, Du M ) 


f x v - x 2 , P s 

X P 

p 


+( 7? 22 + DuN Dn) u> 


where A C , P is defined by (3.10). The *’s denote matrices which are unimportant for this 
argument. The system on the right is internally stable if and only if the system described 
by the above set of equations is internally stable. If we also derive the system equations for 
the system on the left in (3.13) we immediately see that, since A,,, p is asymptotically stable, 
the system on the left is internally stable if and only if the system on the right is internally 
stable. Moreover, if we take zero initial conditions and both systems have the same input w 
then we have s = z v i.e. the input-output behaviour of both systems are equivalent. Hence 
the system on the left has II ^ norm less than 1 if and only if the system on the right has 
77 oo norm less than 1 . 

By lemma 3.9 we may apply lemma 3.8 to the system on the right in (3.13) and hence we 
find that the closed loop system is internally stable and has 77^ norm less than 1 if and only 
if the dashed system is internally stable and has II ^ norm less than 1. 

Since the dashed system is exactly the system on the right in (3.12) and the system on the 
left in (3.13) is exactly equal to the system on the left in (3.12) we have completed the proof. 


Using the previous lemma, we know that we only have to investigate the system Ep. This 
new system has a nice property which is outlined in the following lemma: 


Lemma 3.11 : There exists a matrix Iq such that if we define: 

F\,p — + (7 — 

P't ,p = -Dl liP D„,p 

then we have: 

(i) A P + BF iiP is stable, 

( *"*"') C*,p + D 2it pFi p = 0 , 

(iii) D 2 j p + D 2 \,pi 2,p — 0- 

Proof : We firs* write everything in terms of the new basis introduced in the previous 
section. Hence the system parameters have the special form described by (3.1). Then it is 



easily checked that conditions (ii) and (iii) are always satisfied, independent of the specific 
choice for Fq. If we also write the matrix Fq in the new basis, 


/ *0.11 
V *0,21 


*0,12 

*0,22 


) 


then we have: 


A P + BF\ t p ~ 


l An+2?U*b,ll 

V 0 



where * denotes a matrix which is unimportant for our argument. According to lemma 3.2, the 
matrix A ciP is asymptotically stable. Moreover, as noted in the previous section (An, fin) is 
controllable. Hence, any matrix Fo such that An + i?n*b,ii is stable satisfies the conditions 
of our lemma. Moreover, controllability guarantees the existence of such matrices Fq. ■ 


Remark: The above lemma implies that the full-information feedback u = F lP x P + F iP w P 
applied to £p yields a stable closed loop system for which the closed loop norm is equal 
to 0. 

Next, we will look at the Riccati equation for the system Ep. It can be checked immediately 
that X = 0 satisfies (a)-(c) of theorem 2.1 for the system E P . 

We dualize £p. We know that (A, £,Ci, Da) has no invariant zeros on the unit circle. It 
can be easily checked that this implies that (Ap,E,C lP ,D\ 2 ) has no invariant zeros on the 
unit circle. Hence for the dual of £ P we know that (Ap, C, T p, E T , jDJi ) has n ° invariant zeros 
on the unit circle. If there exists an internally stabilizing feedback for the system £ which 
makes the Hoo norm of the closed loop system less than 1 then the same feedback is internally 
stabilizing and makes the JIoo norm of the closed loop system less than 1 for the system £p. 
If we dualize this feedback and apply it to the dual of Ep then it is again internally stabilizing 
and again it makes the H&, norm of the closed loop system less than 1. We can now apply 
lemma 3.3 which exactly guarantees the existence of a matrix Y > 0 satisfying the following 
conditions 


(«) Y is such that S P > 0 where 

W P := D„, p DJ 3P + C llP YCZ P , 

S P := / - Dji pDli p - C 2iP YCf P 

+ (C 3 , p YCIp + D»,pDl p) wl (C l P YCZ P + D», P Dl p ) . 


(ti) Y satisfies the following discrete algebraic Riccati equation: 


Y = ApYA r p + EpEl 


(C^YAI + D >a ,pEj.\ T t fC. pYAl + D„. P E*\ 
\C,,pYAl + D ia ,pElj PK ’ \C,,pYAl + D„,pEj) 


where 


H P (Y) := 


/ Di3,pDj 3r 

\D 3il pDj 3 p 


Bi» lP Dj tiP \ /C.,p\ y fCi,p\ 

D 33 , P Dl 3P — ij \C 3 pJ \C 3 ,p) 


(3.14) 


(3.15) 



(in) Y satisfies a stability condition: for all z 6 C with |z| > 1, we have 


/ si - A C,, P YAJ + D„, P El 
I ~Ci,p Ci,pYC*p ■+■ D t3 ,pDj JiP 
\ -C a ,e Ct'pYCjp + D n ,pDj a p 


C a ,pYAl + D aa , P El \ 
C,,eYCj p + D la ,pDlp 
C a ,pYC a P + U aa ,pDj a p - 1 ) 


= n + q + ruik K(t) Ci(zI - A)~ l E + D\% 


Note that Y satisfies the conditions (d)-(f) of theorem 2.1 for the system £p. 

The following lemma relates the existence and the solution of the above conditions to the 
conditions in theorem 2.1: 


Lemma 3.12 '.There exist a matrix Y > 0 satsfying the above conditions if and only if there 
exist matrices P > 0 and Q > 0 satisfying the conditions in part (ii) of theorem 2.1. Moreover, 
tn that case we have: 

Y = (I-QP)-'Q □ 


The above derivation yields the necessity part of theorem 2.1: 


Lemma 3.13 '.Let £, described by 2.1), be given with zero initial condition. Assume that 
(.4, B,C 2 , D 21 ) and (A, E,C\, Du) have no invariant zeros on the unit circle. If part (i) of 
theorem 2.1 is satisfied then there exist matrices P and Y satisfying (a)-(f ) of part (ii) of 
theorem 2.1. □ 

This completes the proof (i) => (ii). In the next section we will prove the reverse implication. 
Moreover in case the desired compensator Sf exists we v/ill derive an explicit formula for one 
choice for which satisfies all requirements. 

3.3 The transformation into a disturbance decoupling problem with mea- 
surement feedback 

In this section we assume that there exist matrices P and Q satisfying part (ii) of theorem 2.1 
for the system (2.1) and we show that the part (i) of theorem 2.1 holds. First we transform 
our original system £ into another system £/>,y. We will show that a compensator is internally 
stabilizing and makes the H 00 norm of the closed loop system less than 1 for the system £ 
if and only if the same compensator is internally stabilizing and makes the H x norm of the 
closed loop system less than 1 for our transformed system £p,y< Next we will show that £ F , y 
has a following very special property (see [11]): 

There exists an internally stablizing compensator which makes the closed loop 
transfer matrix equal to zero, i.e. w does not have any effect on the output of the 
system z. This property of £p, y ha-i a special name: u the Disturbance Decoupling 
Problem with Measurement feedback and internal Stability (DDPMS) is solvable”. 



Wc know a matrix V := (/ - QP)~*Q exists satisfying the conditions as outlined in the 
previous section. Next, we define £,»,>•. We start by transforming L' into Then we apply 
the dual transformation on £?> to obtain Ep iV : 


Ap,v 

C a ,p lY 

Bp,y 

Ep, v 
Du, P,Y 
Dn, p< ) 

D 23 ,r,y 


(JXpy — ApyXpy -f BpyUpy + EpyXL'py , 

r. i n ... 


V/*,V = Ct'PXpy 


+ DuyyWpy, 


*,> — i ,r~ r,r ■ ii.r.i “ r.t i 

•r = Ct'PyXpy -f Dn pyUpy + D 12 ,pyWpy. 


(3.16) 


= Ap - (ApYCj p + EpDj, p ) W'pC t ,p 
= E P - (ApYCjp + EpD\ p ) WlD». P 
= Ap + {A v YClp + E y Dl iP )S;'Ci,p 

"* VJ.P 

= fl + VCJ„ + E v Dl iP )S; 1 D it ,p 

= (.4 r vc,% + EpDl p + [A,YC* tP + r„Z?L + D„,pDj , iP ] |) (W'J'*)» 

= IV// 5 
= Sp Xn D»,p 

:= s: ,/2 (c,.pYC7. + d„ pD7. j nrW 


When we first apply lemma 3.10 on the transformation from E to E P and then the dual of 
lemma 3.10 on the transformation from Up to E/> iV we find: 


Lemma 3.14 : Let P satisfy theorem 2.1 part ( i '» ) (a)-(c). Moreover let an arbitrary linear 
time-invariant finite-dimensional compensator Ef be given, described by (2.2). Consider the 
following two systems, where the system on the left is the interconnection of (2.1) and (2.2) 
and the system on the right is the interconnection of (3.16) and (2.2): 



Then the following statements are equivalent : 

(«) The system on the left is internally stable and its transfer matrix from w to z has 
H oo norm less than 1. 

(it) The system on the right is internally stable and its transfer matrix from w PY to z PY 
has Hgo norm less than 1 . □ 


It remains to be shown that for £/> >• the (DDPMS) is solvable. We first need the following 
preliminary lemma 





Lemma 3.15 : There exist a matrix A'o such that if we define: 

K\,P,Y = + Ao(f “ ^IJ,P,l'^!i l /> l >') 

Aj ,P,Y = 

then we have: 

(i) + ^i.p.yCi.p w stable, 

(il) Epy + A'j.py Z?«,py = 0, 

(m) Dn.r.Y + A a,/>,y^ia,p,r = 0* 

Moreover, let F,.#> and F 2 , P fcc as defined in lemma 8.11. If we define 

F\ ,P,Y := £|,P> 

Ej,P,Y ~ I^li.P.Y D»t,P,Y 

then we have: 

(i®) Apy “f - J3F|,p,v = 4 BE\,p is stable, 

(f) C t ,P,Y + Dtt'PyFi'P — 0, 

(*’*") 2,P,Y + D*\ pP.yAj.py ~ 0, 


□ 


Proof : The construction of a suitable matrix A'o satisfying conditions (i)-(iii) is dual to the 
derivation of a suitable Fq satisfying the conditions of lemma 3.5. Hence details are omitted. 
Conditions (iv)-(vi) can be checked via straightfoprward algebraic manipulations. ■ 

Remark: The first part of the lemma is dual to lemma 3.11 and shows that because of the 
dual transformation we can now observe the states of Spy perfectly. Surprisingly enough the 
property that E p could be controlled perfectly is preserved: the second part of the lemma 
6hows that also for Spy we can find a full-information feedback that stabilizes the system 
and yields a closed loop system with H oonorm equal to 0. 

Now we are ready to show the solvability of (DDPMS) for the system Spy in the following 
lemma. 


Lemma 3.16 : Let Ep be niven by: 


£f: - 

[ &P — A p t yP + Lpyppy* 
[ Up,Y ~ M p,yP T Apyjfpy, 

where 


Np,Y 

• = “Aj.py Aj.py 

Mpy 

'= F i,py — Np,vC tl p 

I>P,Y 

:= BpyNpy - A i py 

I- P,Y 

•— Ap t Y + BpyMp'Y + A',,pyC\ 


(3.17) 


The interconnection of E f and Spy is internally stable and the closed loop transfer matrix 
from w PtY to 2 p>- is zero. □ 


Proof : We can write out the formulas for a state space representation of the interconnection 
of V and E/r. We then apply the following basis transformation: 

('V')-U "/)(?)• 

After this transformation one immediately sees that the closed loop transfer matrix from w PY 
to ZP'Y is zero. Moreover the system matrix (2.3) after this transformation is given by: 

/ Ap,Y + Ki,p,yC\ <p 0 \ 

\ Lp'vCt'P Ap'Y + Bp iY F<,p,y ) 

Lemnvv 3.15 guarantees that this matrix is asymptotically stable. Hence Ef is internally 
stabilizing. ■ 

We know Ef- is internally stabilizing and the resulting closed loop system has H x norm less 
than 1 for the system E/>v Hence, by applying lemma 3.14, we And that E f satisfies part 
(i) of theorem 2.1. This completes the proof of (ii) => (i) of theorem 2.1. We have already 
shown the reverse implication and hence the proof of theorem 2.1 is completed. 

4 Controller structure 

In the previous section, we found a controller for E which satisfies all requirements, but its 
structure is very cloudy. In this section we define a controller, which also achieves disturbance 
decoupling when applied to E />,»•, but which has a very appealing structure. 

We first need to construct a matrix with a desired stability property: 


Lemma 4.1 ‘.There exists, a matrix A'o such that 

[f ■+■ Ao (/ - (Ap,j- — Ep, Y D\ 2i py) 

is stable. □ 


Proof : According to lemma 3.15 there exists a matrix Kq 6uch that A\ + KqC\ i6 stable 
where 

Al = (Apy — EpyDIjP'y) 

Cl — (J — Dh'P'yDIjpy )C tl p 

Since, for discrete time systems detectability of (Ci,Ai) implies that the pair (CiAj, Ai) is 
detectable there exists a matrix K 0 such that A\ + K 0 C\Ai is stable. Thi6 implies that A'o 
satisfies the conditions of the lemma. ■ 

Remark: This lemma might look rather strange but it is essential. If we use one-step- 

ahead predictors then the estimator is stable if the filter gain I\ is such that A + I<C is 
stable. However, in this section we use current estimators where we also use the measurement 


y(k) to estimate x (k). In that case the estimator is stable if the filter gain satisfies (I + KC)A. 
Intuitively the above lemma tells us that we can find a stable current estimator if we can find 
a stable one- step- ahead estimator. 


Note that an optimal full-information feedback for L PtY is given by: 

= £i,#\v*/>,v + F ti p lY Wp lY 

where we change F tiPY with respect to the previous section into: 

F t , P ,y := -Dl llP ,yD„, P , v + (/- Dl iPi yD iliPl y)F 0 YCZ P (W P )'. 

It can be shown, along the same lines as the proof of lemma 3.16 that the following controller 
stabilizes E P y and achieves disturbance decoupling: 

Op — A Pi yp + BpyUny -f EpyW — Aolll(<7J/ — C\ :P \A P yP + B P yU P< y -f £p,ytlD]) 

W = F)\ t , P ,y(y P ,y — C X]P p) 

U P,Y = F i ,pyX 4 F i,p,yW 

where 

n, = / - D lilP ,yD\ 3tP y = / - W P Wl 

We arc* going to apply this controller to the system E. However, if we rewrite this controller 
in terms of the original system parameters it has a very special structure: 


ox — Ax + Bu 4- Ew -1- oK\(y - y) 

ow = ER~ l (E T PA x + D 22 C x )[Ax + Bu + £ti>]) + oK 2 (y - y ) 

oy = Ci[Ai Bu 4- Ew) + D l2 ER~HE T PA X -»- Dl 7 C x ){Ai + Bu + £ti>]) 
u = F\i -f F 2 w 

where 

A'i = -£ 0 n, 4 ycj p wUi + C\, P K 0 n: ) 

K 2 = £>^,pl^(/ + C lt pA’ 0 n,) 

while F\ and £2 are defined by (2.10) and (2.11) respectively. We see that we have a full- 
information feedback: 


u = £i» 4- F 2 w 

where we replace the state x and the disturbance w by their respective estimates x and w. 
For the state and and the disturbance we have build e mators. If we write s(k\k) for the 
estimate of the variable s at time k using measurements y(0), . . .y(k) and s(k\k - 1) for the 
estimate of the variable s at time k using measurements y(0), . ..y(k- 1) then we can express 
the structure even clearer. We get the following form: 




x(k + l\k + 1) = x(k + l|Ar) 

w(k 4 l|fc 4- 1) = w(k 4- l\k) 

x(k 4- 1| k) = Ax(k\k ) 4- Bu(k) 4- Ew(k\k) 

w(k 4- lffc) = ER~ l (E T PA x 4- D^C x )x(k 4- l|Jb) 

y(k 4- 1| k) = C\x(k 4 - l|Jt) 4- D u w(k + 1|*) 

u(k) = F lX (k\k) + F 2 w(k\k) 


+A'i [y(k + \) - y(k + \\k)) 
4-A - 2 [y(*4- l)-y{k+ 1|*)] 


Note that in the state feedback case we can identify a worst-case response for the disturbance 

u>: 


w(k) = ER~ i (E J PA X + Dl 2 C t )x(k) (4.1) 

In the above controller we have to estimate w(k + l|fc). Clearly past measurements do not 
tell us anything. However, this controller expects the worst-case response (4.1) and estimates 
this worst-case response. 


5 Reduced order estimator based controller 


In this section we show that for the singular //<» optimal control problem satisfying part (i) 
of theorem 2.1 we can always find a solution which has dynamical order less than that of 
the plant and is of reduced order observer- based structure. This result is analogous to those 
obtained in [16] for the continuous-time problems. Without loss of generality, we develop 
such a reduced order observer- based controller for the system Ep,y defined in the previous 
section. Consider the S P Y defined by (3.16). There exists a constant output prefeedback law 
FprcVpy such that after applying this prefeedback law, namely setting 

t* p,y — * Ppreyp.Y + Up, J-, (5.1) 

the direct feed-through term from w P Y from z PY disappears. Hence without loss of generality, 
hereafter we assume that D 2 3iPy = 0. Also, there exists a 6tate feedback gain F PY such that 

(C a ,p,y + Dm>F P y)(sI — A P y — B py F py ) 1 E py = 0. 


Without loss of generality but for simplicity of presentation, we assume that the matrices 
C v ,p and D i2i p,Y are already in the form 



where mo is the rank of D n P y and £ 12.0 is of full rank. Then the given system h PiY can be 
written as, 


[•(:;) 

(:) 


• ( 


An A 12 
Mi A22 
0 Ci ,02 
0 


Zp.Y 


)(:;)* U) 
)(:;M°r) 
•(:;) 


U>P,y + 


C;) 


U P,Y 


Wpy 


(5.3) 


+ -Cjl.P.y Upy 


where (x\, x' 2 )' — x PY and (y' 0 , y[)' = y PiY . We note that y\ = x\. Thus, one needs 
to estimate only the state X 2 in the reduced-order estimator. Then following closely the 
procedure given in [16], we first rewrite the 6tate equation for xi in terms of the measured 
output yi and state x 2 as follows, 


o'yi = Anyi + j4i2*2 + E\w p . y + 2?itip iV , 


(6.4) 


(5.5) 


where y\ and u Py are known. Observation of x% is made via j/o and 
V\ = Ai 2 x 2 + EyWpy = ayi - Aut/i - B\U Py . 

A re meed-order system for the estimation of state £2 is given by 

(7*2 = Ar*2 + E%w PtV -I- ( A 21 Bj ) ^ ^ , 


(5.6) 


Vr = Cr*2 + DrWps 


where 


Ar := A 22 , E k := E 2 , C R := ( ^’° 2 ) , i> R := ^ Z? “’° ) . 
Based on (5.8), one can construct a reduced-order observer for * 2 as, 
0*2 = A R x 2 + ( A21B2 ) ^ j + A’ r [C r *2 - y R ], 


(5.7) 


(5.8) 


where A' R is the observer gain matrix chosen such that. A R + A’ R C R is asymptotically stable. 
For the purpose of implementing (5.8), let us partition A' R = (A' R o* A' r i ) to be compatible 
with the dimensions of the outputs (y' 0 , y\)', and at the same time define a new variable, 

v := *2 4- A’ri&'i- 

YVe then obtain the following reduced order estimator based controller, 
erv = (A R + KrCr)v + (i ?2 + A RiBijup, y + Gp,y Pt y, 

*p,y = ( T ° )»+(! !■ (5.9) 

\ In-p+mo ) \ 0 “Ari / 

U P,Y = E Pi yX Pi y + F prcVp.y 1 

where 


C R = [— A'roi A 21 + A'ri An - (A R + A' r Cr)A’ri], 

and F P Y is state feedback gain and F pre is the output prefeedback gain. We know that there 
exists an output injection such that: 


(5.10) 


/ An 

Au ^ j 

( A„ A, 2 \ 

( 0 C\fi2 \ 

V A21 

A 22 J 

V A 2 i a 22 ] 

\ Ip-mo ® / 


is 6table and 


( El \ + ( A l2 \ ( Dl2i0 \ = 0 
\E 2 ) V *21 A 22 )\ 0 ) 


(5.11) 


Because the matrix in (5.10) is stable there exists a matrix L such that 


A 2 2 + A' 2 iCi,o 2 + A(Ai 2 + A'hCi,o 2 ) 


is stable. Moreover (5.11) implies that 


E 2 + A'2i-Di2,o + L(E i + KuD l2 fi) - 0. 

Then it is easy to check that a suitable choice for A' R is given by: 

A'r = ( A'ro A' r i ) = ( A 21 + AA'tj L ) 

Remark : It is interesting to point out that the state space representation of the reduced 
order estimator based controller in (5.9) might not be minimal and hence the McMillan degree 
of this controller might be less than the dynamical order of its state space representation (5.9). 
This is mainly due to the stable dynamics which are unobservable in the controlled output 
z PiY and they are induced by the output prefeedback law (5.1). A very interesting example 
is the state feedback case for C\— I and Dn = 0. In this case F PtV can be chosen as a zero 
matrix and the output prefeedback law F prt in (5.1) is equal to F\ } p given in Lemma 3.11. 
In view of this, the reduced order estimator based controller (5.9) has McMillan degree equal 
to zero and it reduces to the static state feedback solution 

up,y = F l<p y. 

6 Conclusion 

In this paper, we removed some standard assumptions on the system parameters. Moreover, 
we specified the structure of discrete time Z/oo controllers. Finally, we showed how to derive 
controllers of lower dynamical order without loss of performance. This is done by deriving 
reduced order observers. Our results are obtained under the assumption that both systems 
(A, J?,C 2 ,i? 2 t) and (A, E,C\, D\i) are free of invariant zeros on unit circle. A most trivial 
technique to handle invariant zeros on unit circle is to perturbe the plant data such that the 
perturbed plant satisfies our assumptions. However, the resulting criteria for the existence 
of the solution to the control problem for the perturbed plant are not algebraic in the 
nature. Hence the derivation of algebraic criteria directly in discrete domain for this case is 
an open problem. 

Via the bilinear transform and our knowledge about the problems of invariant zeros on the 
imaginary axis for control problems in continuous time (see [5, 7, 10]), we know that in 
the case of invariant zeros on the unit circle several problems arise. These are mainly due to 
the fact that #00 controllers have a tendency of cancelling stable zeros of the system and will 
try to achieve this approximately if there are zeros on the unit circle. Hence we have poor 
stability margins. Moreover, the minimal achievable norm may depend discontinuously 
on the system parameters if there are invariant zeros on the unit circle. Hence we also have 
numerical difficulties. The main problem in this respect is the nonuniqueness of (sub)optimal 
Hoc controllers. Suppose we want to get closer and closer to the minimal achievable Hoc norm. 
When can we avoid almost pole-zero cancellations near the unit circle? Fbr this question, very 
little is known. However there are examples where we can get very good stability margins even 
though there are zeros on the unit circle. Similarly there are examples where we always have 
bad stability margins near optimality. What is needed is a characterization of the achievable 
stability margin near optimality. 
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